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(54) Method and device for data flow control 

(57) A method and device of controlling the flow of a 
data amount from a sender to a receiver in a packet 
exchange connection, said packet exchange connec- 
tion consisting of a plurality of links connected by rout- 
ers, comprising: controlling said sender to determine 
from said data amount a data sequence to be sent, 
automatically determining one or more bandwidth val- 
ues respectively associated with one or more of said 
links, and employing said one or more bandwidth values 
in the process of controlling the flow of said sequence 
from said sender to said receiver. Thereby a flow control 
is achieved that can directly take properties of the con- 
nection into account. 
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Description 



[0001] The present invention relates to a method and 
device for data flow control in a packet exchange con- 
nection. 

[0002] The so called internet is a communication net- 
work that comprises a number of different service lay- 
ers. The lowest layer is the hardware layer, onto which 
software layers of different functions are added. As 
example, the so called world wide web (WWW) is a 
layer above the basic internet layer provided by the so 
called internet protocol (IP). 

[0003] The internet is a packet exchange network, 
where the basic structure of information is determined 
by the internet protocol IP. A protocol is a set of rules to 
which two partners in an intended communication must 
adhere to thereby enable said communication. The 
internet protocol IP regulates addressing, i.e. it ensures 
that routers between two communication points are 
capable of sending data packets to their destination. An 
IP packet consist of a header, which contains informa- 
tion relating to data being sent, and a body containing 
the data itself. 

[0004] In order to facilitate the reliable transmission of 
data between two ends of a communication, a further 
protocol is provided, the transmission control protocol 
(TCP). TCP takes the information to be sent, and 
divides it into given segments. Each segment receives a 
number, so that the receipt of a given segment can be 
acknowledged by the receiver and the receiver is able to 
put the information together in the correct order. TCP 
has its own header carrying its own information that is 
used by this protocol. The TCP packets are sent over 
the internet by being placed into IP packets, i.e. the TCP 
packet is encapsulated in the (lower layer) IP packet. 
This is why the transport of packets across the internet 
is often referred to as TCP/IP. 

[0005] Figure 2 shows a body of data 1 00 divided into 
8 data segments of equal size, respectively numbered 1 
to 8. As an example, the body 100 could have a size of 
8192 bytes, so that each data segment would comprise 
1024 bytes. It has to be noted that the information that 
actually needs to be sent will usually be somewhere 
between 7168 bytes and the above mentioned 8192 
bytes, and that the final data segment 8 will simply be 
filled by so called padding to thereby achieve equal 
sized data segments. The precise size of a single data 
segment is not fixed to the above chosen example of 
1024 bytes, but will be appropriately selected by a send- 
ing system in accordance with given constraints, e.g. 
the maximum transmission unit (MTU) allowed by a 
specific link. 

[0006] The method by which TCP controls the flow of 
data segments is the method of "sliding windows". This 
concept is e.g. described in the book "TCP/IP Illus- 
trated" by W.R. Stevens, Volume 1, Addison Wesley, 
1 994, chapters 20 and 2 1 . 

[0007] The term "window" describes an amount of 



bytes, or more generally a data amount expressed in 
units of data. According to TCP, the receiver sends a so 
called "advertised" or offered window to the sender in 
response to a packet from the sender that initiates com- 
5 munication. A TCP sender is not allowed to have more 
unacknowledged packets outstanding than the amount 
defined by the advertised window. It should be noted 
that the receiver sends an advertised window in each 
acknowledgment message or packet. 
10 [0008] The advertised window usually corresponds to 
the input buffer capacity on the receiver side. Thereby, 
the function of the advertised window is to prevent a fast 
sender from letting the input buffer of a slow receiver 
overflow. 

is [0009] The mechanism of sliding window control will 
be explained in the following by referring to Fig. 3 and 4, 
which illustrate an example of sending the data amount 
100 shown in Fig. 2, and by referring to Fig. 5 and 6, 
which illustrate the principal of sliding window control. 
20 [0010] Fig. 3 illustrates an example of the transmis- 
sion of the 8 segments of data shown in Fig.2, where 
the sender is shown on the left hand side and the 
receiver is shown on the right hand side. Each arrow 
indicates the sending of a packet, where the double 
25 lined arrows correspond to packets containing the data 
segments, as will be explained in more detail below. The 
sending of individual packets is illustrated by reference 
signs S1 to S20, where each act of sending from either 
of the two sides is also referred to as a segment. This 
30 indicates that generally one packet containing the data 
of Fig. 2 will contain one data segment. The direction of 
time is from top to bottom. 

[001 1 ] It should be noted that the sequence shown in 
Fig. 3 is a simplification for explaining the flow control, 
35 and therefore not all packets carry a reference sign, as 
these relate to other aspects of communication. Also 
some of the segments carrying reference signs also 
carry more data, but as this supplementary data again 
relates to other aspects of the communication than flow 
40 control, it is not illustrated here. The notation X:Y(Z) 
means that bytes number X to Y are sent, which make 
up a total of Z. Ack X means that the receipt of bytes up 
to number X is acknowledged, and Win X means that a 
window of X bytes is advertised. 
45 [0012] The segments S1 to S3 between sender and 
receiver relate to the establishment of communication, 
and will not be explained further, except that the 
receiver announces a window of 4096 bytes in segment 
S2. In segments S4 to S7 the sender sends the first 
so three data segments 1 to 3. i.e. the bytes 1 to 1025, 
1025 to 2049 and 2049 to 3073. The receiver acknowl- 
edges the receipt of the bytes up to 2049 in S7. where 
S7 again advertises a window of 4096. Why the receiver 
does not acknowledge up to 3073 is of no importance 
ss for explaining flow control. It is e.g. possible that this 
data segment is delayed in processing on the receiving 
side. In segment S8 the receiver acknowledges up to 
3073 and advertises a window of 3073. Again, the rea- 
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son for this is of no importance for the explanation of 
flow control. It is e.g. possible that there is still a delay in 
the receiver's input buffer, and therefore the reduced 
window serves to prevent overflow. In segment S9 the 
sender sends one more data segment, namely bytes 
3073 to 4097. These are acknowledged in segment 
Si 0, in which again a window of 4096 is advertised. The 
sender then sends three data segments in segments 
S11 toS13, namely bytes 4097 to 5121, 5121 to 6145 
and 6145 to 7169. In segment S14, the receiver only 
acknowledges up to byte 6145, but continues to adver- 
tise a window ol 4096. In segment S15, the sender 
sends the last data segment consisting of bytes 71 69 to 
8193, where the receiver acknowledges the receipt of 
all bytes up to 8193 in segment S16. The remaining 
exchanges S17 to S20 do not relate to flow control. 
[001 3] As can be seen, not every data segment needs 
to be acknowledged individually, the receiver can also 
acknowledge the receipt of a number of data segments 
up to a given segment with one acknowledge message. 
[0014] Fig. 5 shows the principle of sliding window 
based flow control. The numbers 1 to 1 1 refer to data 
segments, e.g. these can be the data segments shown 
in Fig. 2, or simply be a given number of bytes. With 
respect to the explanation of window based flow control, 
it is only important to note that the window 200 covers a 
certain amount of data, where the control window 
between left edge 201 and right edge 202 covers data 
segments 4 to 9. In the example of Fig. 5 the control 
window is the advertised window. (Another type of con- 
trol window will be described later.) The position of the 
left edge of the window 200 is determined by the 
number of data segments already sent (by the sender) 
and acknowledged (by the receiver). In Fig. 5, this 
means that data segments 1 to 3 have been sent and 
acknowledged. 

[0015] Although the data flow above is explained in 
connection with the example of a sequence of seg- 
ments, it should be noted that TCP is a stream oriented 
protocol, such that the sequence base is in terms of 
bytes. Therefore the acknowledgment messages from 
the receiver do not indicate received segments, much 
rather they indicate up to which byte of the sequence 
data has been received. 

[0016] The sender calculates the usable window, i.e. 
the amount of data that can be sent, as the difference 
between the total window size and the amount of data 
that has been sent but not yet acknowledged. In Fig. 5, 
the usable window from divide 203 to right edge 202 
covers data segments 7 to 9. Therefore, these data can 
be sent. The data segments beyond the right edge 202, 
i.e. 10. 11. etc., cannot be sent until the window moves 
to cover them. The movement of the window shall be 
explained in the following. 

[001 7] Fig. 6 shows the principle of adjusting the win- 
dow in time. Overtime the window moves to the right, as 
the receiver acknowledges data. The relative motion of 
the two edges 201 and 202 increases or decreases the 
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size of the window. Three different terms are conven- 
tionally used to describe this motion: the window closes 
as the left edge 201 moves to the right, the window 
opens as the right edge 202 moves to the right, and the 

5 window shrinks as the right edge 202 moves to the left. 
The movement of the edges 201, 202 is governed by 
the position of the left edge 201 in accordance with how 
much data has been sent and acknowledged, and by 
the advertised window size, which starting from a given 

ro left edge 201 determines the right edge 202. It may be 
noted that the left edge does not move left, and if an 
acknowledgment (ACK) were received that implied 
moving the left edge to the left, it would be a duplicate 
ACK and consequently discarded. 

is [0018] If the left edge 201 reaches the right edge 202, 
then the resulting window 200 is called a zero window. 
This stops the sender from transmitting any data. 
[001 9] The above described principle of flow control is 
illustrated with reference to Fig. 4, which explains the 

20 sliding window flow control for the example given in Fig. 
3. The top of the figure shows the data segments of Fig. 
2, and the bars and arrows below represent and illus- 
trate the movement and change of the flow control win- 
dow in time, in response to the sending of data by the 

25 sender and the acknowledging by the receiver. As can 
be seen, the sender does not have to transmit a full win- 
dow's worth of data. Each acknowledgment from the 
receiver slides the window to the right. The size of the 
window can decrease, as shown by the change from 

30 segment S7 to S8, but the right edge of the window 
must not move leftward. Also, the receiver does not 
have to wait for the window to fill before sending an 
ACK. 

[0020] In the above description, the window that deter- 
35 mined the flow control was the advertised or offered 
window from the window. In other words, the advertised 
window is the instrument with which the receiver influ- 
ences the flow control, which itself is naturally per- 
formed by the sender. As already mentioned, the 
40 receiver uses the advertised window to prevent an over- 
flow of its input buffer. Usually therefore the size of the 
advertised window is controlled by the receiving proc- 
ess. 

[0021 ] Besides the problem of a fast sender causing a 
45 slow receiver to overflow, there also exists the problem 
that congestion can occur on the network. This is a 
problem which occurs not at the receiving end of a con- 
nection, but between the sending and receiving end. As 
is well known, a typical connection on the internet is 
so established through other members, which act as rout- 
ers, and these routers can be connected by widely var- 
ying types of hardware, where such connections 
between routers are commonly referred to as links. In 
other words, a packet from a sender to a receiver will 
55 guided by routers through links to other routers until it 
arrives at the receiving end. Congestion is the effect 
that occurs when a given link is not large enough (does 
not have a sufficient transmission capacity) to handle 



3 

1NSDOCID: <EP 0948168A1_I„> 



EP 0 948 168 A1 



the amount of data to be sent through said link. This can 
e.g. happen when data arrives on a link having a large 
capacity ("big pipe", e.g. a fast LAN) and exits on a link 
having a lower capacity ("small pipe", e.g. a slow WAN), 
or when multiple input streams arrive at a router whose 
output capacity is less than the sum of the inputs. 
[0022] Figure 7 shows an example of congestion. In 
this figure, packets containing data segments like the 
ones shown in Fig. 2 and accordingly carrying numbers 
1 to 8, arrive at a router R1 over a link 300 having a 
large transmission capacity. Link 301, into which Ri 
routs the packets, is smaller than link 300. It should be 
noted that the packets are represented with hatched 
areas, where the area corresponds to the size of the 
packet. This means that the area of packet 3 or 4 shown 
in link 301, is equal to the area of packets 5 or 6 in link 
300, or of 1 and 2 in link 302. As can be seen, R1 acts 
as a "bottleneck", because it cannot send the packets 
into link 301 as fast as they arrive on link 300. As can 
also be seen from the figure, router R2 can only put the 
packets into link 302 as fast as they arrive from the low 
capacity link 301. Consequently, the link of lowest 
capacity determines the spacing of packets. 
[0023] It is to be noted that in the example of Fig. 7 it 
is assumed that the receiver had advertised a window 
having a size that corresponds to 8 segments, so that 
the sender sent all eight as fast as link 300 could take 
them. It is also assumed that router R1 has a sufficiently 
large buffer to store the incoming packets until they can 
be sent out. However, this latter assumption is often not 
fulfilled, so that congestion can lead to the discarding of 
packets, which in turn means that packets need to be 
retransmitted, i.e. transmission is handicapped. 
[0024] In order to take congestion into account the 
control of data flow in TCP is not only performed in 
accordance with the above described advertised win- 
dow, but also in accordance with the so called conges- 
tion window. The congestion window is used by a 
routine called slow start in the following way. When a 
new connection is established, the congestion window 
is initialized to one segment of data. Each time that an 
acknowledgment is received by the sender, the conges- 
tion is increased by one segment. The sliding window 
control explained above (see Figures 5 and 6), is per- 
formed with either the advertised window or the conges- 
tion window, whichever is smaller. In other words, if the 
congestion window is smaller than the advertised win- 
dow, then the control window 200 shown in Fig. 5 would 
be the congestion window and not the advertised win- 
dow. The process of determining the position of the left 
edge of the control window is performed exactly as 
described above in connection with Figures 4, 5 and 6 
but the position of the right edge is determined with the 
minimum of the advertised and the congestion window. 
[0025] The advertised window is determined by the 
receiver, whereas the congestion window is determined 
by the sender. Therefore the congestion window is flow 
control imposed by the sender, while the advertised win- 



dow is flow control imposed by the receiver. The former 
is based on the sender's assessment of perceived net- 
work congestion, the latter is related to the amount of 
available buffer space at the receiver. 

[Problem underlying the invention] 



[0026] When sliding windows flow control is per- 
formed by using slow start and the congestion window 
10 as described above, the sender starts by transmitting 
one segment or packet and waiting for the correspond- 
ing acknowledgment ACK. When that ACK is received, 
the congestion window is incremented from one to two, 
and two segments can be sent. In general, each 
is received ACK increases the window by one. Therefore, 
when each of these two segments is acknowledged, the 
congestion window is increased to four etc. This leads 
to an exponential increase. It should be noted that the 
exponential increase is not in terms of time proper, but 
20 in terms of the so-called round trip time RTT. The RTT is 
the time that passes between the sending of a given 
byte and the receipt of the corresponding acknowledg- 
ment message. Due to this exponential increase, the 
size of the congestion window may rapidly reach a value 
25 that, although it is still smaller than the advertised win- 
dow, lead to congestion, as explained in connection with 
Fig. 7. 

[0027] Congestion will typically lead to packet loss, 
which can be noticed by timeouts occurring in the com- 
30 munication (when a packet is sent, a time-out clock 
starts to run, and if no acknowledgment is received in 
the preset period of time, a time-out is issued) or by 
duplicate ACKs being received. 
[0028] In order to deal with this problem, a congestion 
35 avoidance method is proposed, which is e.g. described 
in chapter 21.6 of the above mentioned book by W. R. 
Stevens. In accordance with this method, which is usu- 
ally implemented together with the above described 
slow start method, a congestion window value and a 
40 slow start threshold value are kept. Initially the conges- 
tion window is set to one segment and the threshold 
value to the maximum window size allowed (typically 
65535 bytes). The control window is chosen as the min- 
imum of the advertised window and the congestion win- 
45 dow. When congestion occurs and this is noticed by a 
time-out taking place, one half the current control win- 
dow is stored as the threshold value and the congestion 
window is set to one segment. Time-out is a function 
according to which a timer measures the time that 
so passes since the sending of a packet, and a time-out 
warning is issued if no acknowledgment is received 
within a predetermined period of time. Then, the slow 
start method is employed (with its exponential increase 
in window size) until the control window size reaches 
55 the threshold value, after which the congestion avoid- 
ance method sets in, which dictates that the congestion 
window be incremented with the reciprocal value of the 
congestion window, which leads to a linear increase in 
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the size of the congestion window. 
[0029] Another indication of congestion is the receipt 
of a duplicate acknowledgment, after which the conges- 
tion window is set to one half of the current control win- 
dow and the congestion avoidance method is used, s 
Time-outs and duplicate acknowledgments, and the 
reactions thereto are well known in connection with 
TCP, so that no further explanation is necessary. 
[0030] As a consequence of the above, the basic flow 
control performed by TCP leads to constant probing for 
more bandwidth by the sender. Bandwidth is defined as 
the rate of data transmission, i.e. is given in unit of data 
per unit of time, e.g. bits/s. This constant probing for 
bandwidth, even if it is done in accordance with the 
above described method of congestion avoidance that 
causes the congestion window to only increase linearly 
after a certain point, has the effect that congestion will 
nonetheless occur, as long as the receiver advertises a 
large enough window. 

[0031] It should be noted that this problem is not 
restricted to TCP, but will occur in any system that 
employs sliding window flow control. 

[Object of the invention] 

[0032] It is the object of the invention to overcome the 
above mentioned problems and to provide an improved 
method and device for flow control. 

[Summary of the invention] 

[0033] This object is solved by the method and device 
described in the independent claims. Advantageous 
embodiments are described in the independent claims. 
[0034] In accordance with the present invention, flow 
control in a connection over which an amount of data is 
to be sent, directly employs information on said connec- 
tion, namely one or more bandwidth values associated 
with links forming said connection. In this way, flow con- 
trol can directly be adapted to the situation on the net- 
work. 

[0035] Preferably, the bandwidth value or values are 
not only determined once, but are determined several 
times during the sending of the data, such that the 
bandwidth value or values are updated and the flow 
control is dynamically adapted to the situation along the 
connection. 

[0036] According to a preferred embodiment of the 
present invention, in a system in which sliding window 
flow control is being used, a window size is calculated in 
dependence on said band widths, and said window size 
is employed in the process of determining a control win- 
dow in said sliding window flow control. 
[0037] Employing said window size in the process of 
determining a control window means that e.g. the win- 
dow is directly used as the size of the control window, or 
is compared with other available window size values 
(e.g. a congestion window size and an advertised win- 
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dow size known from TCP) and the control window size 
is determined from this comparison, e.g. the smallest of 
the available window sizes is selected. 
[0038] The basic effect of defining a window in the 
above described way, is that this new window, which is 
also referred to as the bottleneck window, takes into 
account that one of the links in the connection is capa- 
ble of being the bottleneck for packet transmission, and 
taking the bottleneck window into account during sliding 
window flow control can minimize congestion at one of 
said links whose bandwidth is taken into account for the 
determination of said bottleneck window. 
[0039] According to another preferred embodiment, 
the bottleneck window is determined by obtaining a 
respective bandwidth value for each of the links under 
consideration, determining the minimum of said plurality 
of bandwidth values, determining a time value that char- 
acterizes the amount of time that passes between the 
sending of a given byte and the receipt of an acknowl- 
edgment that said given byte has been received at the 
other end of said connection, and calculating the prod- 
uct of the time value and the minimum bandwidth value 
as the bottleneck window. 

[0040] Preferably, said time value is the round trip time 
value for the given packet exchange connection in the 
direction that the packets are to be sent. 
[0041] According to another preferred embodiment, 
the bandwidth value associated with a link is the physi- 
cal bandwidth of said link, i.e. the total amount of data 
that can be sent through said link at a given point in 
time. According to another preferred embodiment, the 
bandwidth value associated with a link is the actual 
bandwidth value available to the packet exchange con- 
nection at said link. The latter embodiment takes into 
account that more than one connection can be running 
through a link. 

[0042] In accordance with a further preferred embod- 
iment, only one bandwidth value is taken into account, 
namely the available bandwidth of the access link. The 
access link is the link between the device at the end of 
the packet exchange connection and the next router 
along the packet exchange connection. This embodi- 
ment leads to the bottleneck link being defined on the 
basis of the bandwidth of the access link, so that the 
possibility of congestion at said access link can be 
reduced. The access link being measured can be either 
that of the device acting as a sender in the connection, 
or that of the device acting as a receiver. 
[0043] Preferably, this embodiment is such that the 
bandwidth of the access link is provided by the compo- 
nent that controls the link layer through said access link. 
As an example, if the device at the end of the packet 
exchange connection is a personal computer and the 
access link is a modem link to an internet provider, then 
the link layer is established by an appropriate link proto- 
col, such as SLIP (Serial Line Internet Protocol), PPP 
(Point-to-Point Protocol) or RLP (Radio Link Protocol, 
used in connection with GSM) and the component con- 
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trolling the link layer is the driver governing the 
exchange between the personal computer and the 
modem. As another example, the access link can be a 
digital telephone link such as an ISDN line or a connec- 
tion in a digital cellular phone network, where the driver 
then does not control a modem, but controls an appro- 
priate adapter device, such as an ISDN adapter card. 
[0044] This last embodiment has the advantage that it 
is easily implemented, as it can be implemented into 
any member of a packet exchange network without hav- 
ing to change the network or the protocols governing 
the network, and is especially effective if the access link 
contains a radio transmission part, such as an access 
link over a cellular telephone, because in such a case 
the access link will typically be the bottleneck link, i e 
the link among all the links forming the packet exchange 
connection that provides the sender with the lowest 
bandwidth. In other words, in this case the occurrence 
of congestion in the total packet exchange connection 
can be completely avoided if congestion is avoided at 
the access link, which the present invention can ensure 
in the above embodiment. 

[0045] According to another preferred embodiment 
two bandwidth values are determined, namely those of 
the access link of the sender and receiver, respectively. 
In this way, the occurrence of congestion at one of these 
links can be reduced. 

[0046] The present invention offers a simple, effective 
and flexible solution to the above mentioned problem of 
congestion avoidance, and can be applied in any com- 
munication system. 

[0047] It can be especially applied to systems using 
sliding window flow control. As already mentioned, the 
flow control can be conducted by using the bottleneck 
window alone, or by combining the use of the bottleneck 
window with known windows for the given system. For 
example, when applying the invention to TCP, this proto- 
col could be changed such that flow control is con- 
ducted only with the bottleneck window, or the use of 
the bottleneck window can be added to the use of the 
known windows, i.e. the congestion window and the 
advertised window, e.g. by determining the control win- 
dow as the minimum of the advertised window, the con- 
gestion window and the bottleneck window. 
[0048] In the latter case, i.e. when applying the inven- 
tion by adding the bottleneck window to an existing win- 
dow or windows and then selecting the control window 
from these windows, the invention offers the supple- 
mentary advantage that the conventional transmission 
protocol (e.g. TCP) would not have to be changed and 
the invention would still be effective even if it is only 
implemented in one end of a connection. In other words 
in this latter case, compatibility to existing implementa- 
tions of the standard transmission protocol could be 
retained, while still having the benefit of enhanced per- 
formance. 

[0049] By defining a new window to be used in the 
sliding window flow control, namely the bottleneck win- 



dow, a preferred embodiment of the present invention 
departs from the concept laid out in the prior art. in 
which the existing windows (advertised window, con- 
gestion window) were used together with new algo- 

5 rithms, e.g. the above described congestion avoidance 
algorithm. In contrast thereto, by defining the bottleneck 
window, which takes into account local information on 
the bandwidth of individual links among the links form- 
ing the packet exchange connection, the present inven- 

w tion achieves a simple and highly flexible method, where 
the use of this bottleneck window, be it alone or in con- 
junction with known windows, achieves a more effective 
congestion avoidance than the known solutions. 
[0050] These and other advantages will become more 

is apparent from the following description of preferred 
embodiments of the invention, which will be described 
in conjunction with the enclosed drawings, in which: 
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Fig. 1 



Fig. 2 



shows a flowchart illustrating a basic embod- 
iment of the present invention; 

shows an example of a set of data segments 
to be transmitted; 



25 Fig. 3 shows an example of packet exchange 
according to TCP for transmitting the seg- 
ments shown in Fig. 2; 

Fig. 4 explains the motion and adjustment of the 
so control window during the flow control of the 

communication shown in Fig. 3; 

Fig. 5 is a schematic illustration showing the princi- 
ple of sliding window flow control- 

35 

Fig. 6 is a schematic illustration of how the edges of 
the control window move; 

Fig. 7 is a schematic representation for explaining 
40 congestion at a link along a communication 

path; and 

Fig. 8 shows a flowchart illustrating a preferred 
embodiment for determining the bottleneck 
45 window. 



[Detailed description of the invention] 



[0051] Most of the examples given below will be 
so explained in connection with communication in accord- 
ance with TCP. As the present invention can be com- 
bined with the known elements of flow control in 
accordance with TCP, the previous description of flow 
control in TCP is herewith incorporated by reference 
55 into the disclosure of the invention. It should however be 
remarked that the present invention is not restricted to 
being applied to TCP, but may be applied to any com- 
munication system using packet exchange. 
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[0052] A connection between two communication 
partners in a packet exchange network such as the 
internet typically consists of a number of individual links, 
where said links are connected by routers. For example, 
a personal computer may be connected to a server over 5 
a fast LAN, the server to another member of the internet 
(also referred to as an internet protocol peer or IP peer) 
over a slow WAN, and this other member of the internet 
to the receiver, again over a fast LAN. The LAN and 
WAN constitute links, whereas the servers are the rout- 70 
ers, i.e. the devices that route the packets towards their 
destination in accordance with the routing information 
contained in the packets. This situation corresponds to 
what is schematically shown in Fig. 7, where the first 
LAN would be link 300. the first server router R1 , the 15 
WAN link 301 , the other internet member router R2, and 
the second LAN link 302. Another example would be a 
personal computer connected to an internet server over 
a slow modem link, the server being connected to 
another IP peer over a dedicated satellite link, and the 20 
this IP peer being connected to the receiver again over 
a slow modem link. 

[0053] Fig. 1 illustrates a basic embodiment of the 
method of flow control according to the present inven- 
tion. The flow of data in a packet exchange connection 25 
between two communication partners is controlled, 
where said connection consists of a plurality of links 
connected by routers. An example is a TCP/IP connec- 
tion over the internet. In the connection, the partner that 
has data to send is the sender, and the other partner is 30 
the receiver. In a first step St10, the sequence of the 
data to be sent (e.g. an e-mail) is determined for the 
sender. This means that a sequence of data units (e.g. 
bytes) of the data to be sent is determined. 
[0054] In a further step St20, bandwidth values asso- 35 
ciated with at least one of the links in the connection 
over which the data are to be sent are automatically 
determined. This can be done in very many different 
ways. For example, one or both of the partners in the 
connection can monitor bandwidth values of one or 40 
more links in the connection in the direction in which 
data is to be sent, i.e. in the direction from sender to 
receiver. One possibility is to have the routers along the 
connection add these bandwidth values to packets 
being sent to the receiver, or more preferably to 45 
acknowledgment packets being returned to the sender. 
Another possibility is to adapt the link layer driver in one 
or both of the partners to monitor the bandwidth value of 
that partner's access link. The access link is the link that 
connects the partner with the next router in the connec- so 
tion to the other partner. The bandwidth value associ- 
ated with a link can be any value that gives an indication 
of how much data per unit of time said link can carry. For 
example, this can be the physical bandwidth value of 
the link, i.e. the total bandwidth of the link, or more pref- ss 
erably this can be the bandwidth momentarily available 
to the connection at that link. 

[0055] Finally, the flow of said sequence of data is 
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controlled by employing said bandwidth values. This 
means that the flow of data from the sender is controlled 
by automatically taking into account the one or more 
bandwidth values, such that congestion can be mini- 
mized. This can be done, e.g. in a system using sliding 
window based flow control by determining a window 
value from the one or more bandwidth values and then 
using said window value as the control window, or 
selecting the control window from a group that inter alia 
contains said window value. 

[0056] In this way, the present invention achieves a 
system in which the flow of data is controlled in auto- 
matic dependence on parameters directly characteriz- 
ing the connection. 

[0057] It should be noted that the hardware for control - 
ling the flow can be provided in any suitable or desired 
way, e.g. in a device that simultaneously controls both 
partners in the connection, but more preferably the con- 
trol according to the present invention is incorporated 
directly in one or both of the partners in the connection, 
ft is an important advantage of the present invention 
that, according to a preferred embodiment, it can be 
implemented in only one partner of a connection and 
nonetheless achieve an improved flow control for the 
total connection. 

[0058] Fig. 8 shows a flow chart of a preferred embod- 
iment of the method of the present invention. In a first 
step St1 one or more bandwidth values associated with 
the links along the connection are determined. Band- 
width is defined as an amount of data per unit of time, 
e.g. bits/s. It should be noted that the links in the con- 
nection are those that establish the path between 
sender and receiver in the direction in which the packets 
are to be sent or are being sent. This is due to the fact 
that the path or connection along which packets are 
sent from the sender to the receiver is not necessarily 
identical with the path along which packets are sent 
from the receiver to the sender. 

[0059] The mechanism for determining which band- 
width is to be associated with a given link is not essen- 
tial to the invention and can be chosen in any suitable 
way. According to a preferred embodiment of the inven- 
tion, the value to be associated with a given link is the 
bandwidth of the physical connection corresponding to 
said link. As an example, if the link is formed by a 
modem with a transmission speed of 28800 bit/s, then 
the associated bandwidth is 28800 bit/s. H is to be noted 
that the physical bandwidth can either be the absolutely 
maximum bandwidth that a specific link can offer, in 
which case the value is constant for a given link, or the 
maximum bandwidth under the prevailing conditions. 
This differentiation is important when a link is given by 
radio communication, in which case the absolute maxi- 
mum is the value under ideal radio conditions, and the 
prevailing maximum is the value allowed by the momen- 
tary conditions. 

[0060] It should be noted that this physical link band- 
width thus defined is independent of how much band- 
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width is actually available to the connection under 
consideration. As is well known in the art, a given link 
can carry more than one connection, where a share of 
the total (i.e. physical) bandwidth is available to each 
connection. Consequently, according to another pre- 
ferred embodiment of the invention, the bandwidth 
value associated with a given link is the bandwidth cur- 
rently available to the connection for said link. 
[0061] In the embodiment, in which the bandwidth 
value associated with a link is the currently available 
bandwidth, one possibility of determining this value is 
the modification of the basic protocol underlying the 
packet transmission (e.g. IP in the case of packet 
exchange over the internet), such that each link in a 
connection adds this information to the packets being 
transmitted, be it to the data packets sent to the 
receiver, or to the corresponding acknowledgment 
packets sent by the receiver to the sender. However, in 
terms of the present invention, any suitable method of 
determining the currently available bandwidth can be 
used, as the invention does not depend thereon. 
[0062] In the embodiment, in which the physical link 
bandwidth is used as the associated bandwidth, one 
possibility of determining these values is again the mod- 
ification of the underlying network layer transmission 
protocol, such that the links provide this information to 
the sender or receiver (again e.g. IP), it is however also 
possible to use the method of the present invention 
without modifying the underlying transmission protocol 
One possibility is that the relevant bandwidth informa- 
tion be provided not by modifying the basic transmission 
protocol (e.g. TCP), but by using an appropriately mod- 
ified link layer protocol (e.g. SLIP, PPP or RLP) or more 
preferably just a modified driver for such a link layer pro- 
tocol. When only modifying the driver of the link layer 
protocol, the present invention offers the advantage that 
none of the protocols involved need to be changed, so 
that there are absolutely no compatibility problems with 
established systems, and the invention can be intro- 
duced into any member of a network without having to 
change anything in the rest of the network. 
[0063] A link layer protocol governs the communica- 
tion between two partners in the communication over a 
specific link, where said link forms part of the connec- 
tion. A typical example is accessing the internet from a 
personal computer over a modem link to a server The 
communication between the personal computer and the 
server that acts a router will then be conducted in 
accordance with a specific protocol for such links, e g 
SLIP (serial line internet protocol) or PPP (point to point 
protocol). These protocols encapsulate the lower level 
packets, i.e. the TCP/IP packets. These protocols and 
encapsulation are well known in the art, and are e.g. 
described in the above mentioned book by W R Ste- 
vens, TCP/IP Illustrated. The details therefore need not 
be repeated here. 

[0064] The driver used for running the communication 
m accordance with the link layer protocol could then pro- 



vide the information on the physical bandwidth of the 
corresponding link. 

[0065] The advantage of implementing the present 
invention by using the physical bandwidth without mod- 
s ifying the basic underlying transmission protocol (e.g. 
TCP/IP) has the advantage that the invention can be 
integrated into existing systems without compatibility 
problems, while still having the benefit of enhanced per- 
formance. Moreover, the invention can be implemented 
10 in only one partner of the communication and still be 
effective. This means that the present invention is gen- 
erally applicable in any system using sliding window 
flow control, without having to modify the underlying 
transmission protocol of that system. This is a great 
is advantage over the prior art. as all known solutions 
require modification of both communication partners or 
the installation of transport layer state in the network. 
[0066] Returning now to the description of Fig. 8 the 
bandwidth values determined in step St1 represent the 
20 amount of data per unit of time that the links with which 
they are associated can handle. 
[0067] In the next step St2, the minimum of the band- 
width values determined in step St1 is determined If 
only one value was determined, then naturally this value 
25 is the minimum. It is however preferable that more than 
one bandwidth value be determined in step St1 , so that 
the minimum value chosen in step St2 represents the 
bandwidth of the link having the lowest transmission 
speed among the links considered in step St1 . Although 
so it .s preferable that all the links forming the connection 
be taken into consideration, this is by no means neces- 
sary, as will be explained further on. 
[0068] In the next step St3 a time value that character- 
izes the delay along the packet exchange in the send 
35 direction (i.e. the direction from sender to receiver) is 
determined. This characteristic time value will generally 
be associated with the so called round trip time (RTT) of 
the connection. The RTT is defined in a given direction 
as the time that passes between the sending of a byte in 
40 that direction and the receipt of the direct acknowledg- 
ment of said byte. When taking the exchange of packets 
shown in Fig. 3 as an example, the RTT is the time that 
passes between the sending of segment Si by the 
sender and the receipt of the acknowledgment in seg- 
45 ment S2. In other words, the RTT is the difference 
between the time of receipt of the reply to a message 
and the sending of said message, or more specifically 
the time between sending a byte with a particular 
sequence number and receiving an acknowledgment 
50 that covers that sequence number. 

[0069] It should be noted that in the present embodi- 
ment, the above mentioned characteristic time value is 
to be understood as any value indicative of the delay 
time along the packet exchange connection i e the 
55 above mentioned time difference between sending out a 
packet and receiving the corresponding acknowledg- 
ment. Therefore, the RTT or any value derived from the 
RTT is suitable as said characteristic time value. 



BNSDOCID: <EP_ 0948168A1J_ 



15 



EP 0 948 168 A1 



16 



[0070] The determination of the RTT can be done in 
any suitable way. One specific possibility is known from 
chapter 21 .3 of the above mentioned book by W.R. Ste- 
vens, TCP/IP Illustrated. The method disclosed therein 
is not limited to TCP, but can be suitably applied to any 5 
system using sliding window flow control for packet 
transmission. An alternative method is e.g. known from 
the Network Working Group Internet-Draft by V. Jacob- 
son, R. Braden, D. Borman, February 1997. 
[0071 ] In a simplest case, the characteristic time value 10 
can simply be directly determined as the momentary 
RTT by monitoring the time lapse between the sending 
out of a segment having a specific sequence number 
and the receipt of the packet containing the acknowl- 
edgment of the receipt of said segment at the other end, is 
e.g. by an appropriate clock circuit that starts running 
when a segment is sent out, and outputs a value indicat- 
ing the passed time when the corresponding acknowl- 
edgment packet is received. This output value is stored 
as the momentary RTT Such a determination is com- 
pletely suitable in a control protocol that acknowledges 
each individual packet or segment individually, i.e. has a 
one-to-one correspondence of data segments and 
acknowledgment messages. 

[0072] However, in protocols that can also send cumu- 
lative acknowledgment messages, as in the case of 
TCP (see e.g. S7 in Fig. 3. which acknowledges the 
receipt up to 2049 bytes, i.e. the first two data segments 
S4 and S5), it is preferable to determine the character- 
istic time value of step St3 as a smoothed quantity 
depending on the RTT. In this case, the momentary RTT 
is measured as indicated above, i.e. the time delay 
between the sending out of a segment having a specific 
sequence number and the receipt of the acknowledg- 
ment that covers said sequence number (which can 
also cover other sequence numbers). This time value is 
denoted by M. Then an estimator denoted as R is 
updated using a low-pass filter as follows 

R <- aR + (1-a)M, 

where a is a smoothing factor, which in TCP has a rec- 
ommended value of 0.9. The momentary value of R can 
then be used as the characteristic time value in step 
St3. 

[0073] Even more preferably, the characteristic time 
value is measured by averaging the measurement value 
M. This is done by calculating an error value Err and 
updating an average value A at each measurement of M 
in the following way: 

Err = M - A. 
A <r- A + gErr. 

where g is a gain value for determining the average. A 
typical of g is 0.1 25. The momentary value of A can then 
be used as the characteristic time value in step St 3. 



[0074] Finally, in step St4, the product of the minimum 
bandwidth value determined in step St2 and the charac- 
teristic time value determined in step St3 is calculated, 
and this product is defined as the bottleneck window. 
According to the present invention, this bottleneck win- 
dow can then be used in the sliding window flow control. 
The precise use is not essential to the invention, i.e. the 
conditions or requirements according to which the bot- 
tleneck window is used as the control window in a slid- 
ing window flow control as described in connection with 
Figures 5 and 6. 

[0075] According to one embodiment, the bottleneck 
window is constantly used as the control window, i.e. the 
entire flow control is executed on the basis of the bottle- 
neck window. According to another embodiment, the 
bottleneck window is used together with the known 
advertised window, where the control window is chosen 
as the minimum of the bottleneck window and the 
advertised window. According to yet another embodi- 
ment, the bottleneck window is used together with the 
known advertised window and the known congestion 
window, where the control window is chosen as the min- 
imum of the advertised, congestion and bottleneck win- 
dows. 

[0076] According to a simplest embodiment, the value 
of the bottleneck window is only automatically calcu- 
lated once before initiating the sending of the numbered 
data sequence (as e.g. shown in Fig. 2). However, 
according to a preferred embodiment, the value of the 
bottleneck window is determined several times during 
the sending of the segments, such that the bottleneck is 
always updated and correctly reflects the momentary 
transmission state of the packet exchange connection. 
This measuring and updating of the bottleneck window 
can be done every time that further segments are to be 
sent, or periodically at a given time period, or constantly, 
i.e. the device in which the method of the present inven- 
tion is implemented cycles through the process of deter- 
mining the bottleneck window at the fastest possible 
rate, which means that the determining of a new bottle- 
neck window is initiated every time that a cycle of deter- 
mining the bottleneck window has been completed. 
[0077] If the bottleneck window is dynamically 
adapted in the above described way, as the different 
parameters encountered in steps St1 to St3 tend to be 
variable in time, as e.g. the momentary bandwidth val- 
ues available to the connection can change because of 
changing traffic on the network, the senders contribu- 
tion to congestion with respect to said connection at the 
links taken into consideration can be minimized, even if 
the properties of the packet exchange connection 
change. 

[0078] It should be noted that the term "congestion" is 
generally used to refer to the total congestion at a link, 
i.e. the congestion caused by all of the traffic (all of the 
connections) going through said link. It is understanda- 
ble that the present invention can directly only influence 
the part of the total congestion that is caused by the 
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sender in the connection under consideration, i.e. the 
sender's contribution to the congestion. However, mini- 
mizing this contribution will naturally also minimize the 
total congestion. 

[0079] The bottleneck window defined by the present 5 
invention is a means of minimizing congestion at a spe- 
cific link and at all other links having a larger bandwidth 
than said specific link. This is something that the prior 
art is not able to achieve. In other words, as can be seen 
from the above description, the bottleneck window is w 
defined in correspondence to the link with which the 
minimum bandwidth determined in step St3 is associ- 
ated. The use of the bottleneck window minimizes the 
occurrence of congestion at said link. As already 
remarked above, it is preferable that the links taken into is 
consideration in step St1 are all the links in the connec- 
tion. In this case the bottleneck window corresponds to 
the link among those forming the connection that abso- 
lutely provides the lowest bandwidth. However, the 
invention also works when taking fewer links into' con- 20 
sideration in step St1, because then congestion can at 
least safely be minimized at those links taken into con- 
sideration, which is something that the prior art cannot 
guarantee. 

[0080] When the present invention is put to practice in 25 
a device that is a partner in a packet exchange connec- 
tion with sliding window flow control, if said device is the 
sender, then it simply determines the bottleneck window 
in the send direction as described above and suitably 
uses it for flow control. If the partner is the receiver, then 30 
it determines the bottleneck window in its receive direc- 
tion and transmits this information to the sender. For 
example, in a TCP connection in which only the receiver 
operates in accordance with the present invention, the 
receiver can determine the bottleneck window in its 35 
receive direction, and then advertise the minimum of 
bottleneck window and the window he would advertise 
according to standard TCP (e.g. the input buffer limit) as 
the advertised window to the TCP sender. In this way, 
the sender operates in accordance with the invention, 40 
although it has in no way been modified. In this way, the 
present invention has the great advantage that it can be 
integrated into any existing system without any compat- 
ibility problems, while still retaining the benefit of 
improved performance. 45 
[0081 ] The present invention can be implemented in a 
device designed to be a sender or designed to be a 
receiver, but will typically be implemented in a device 
that can act both as a sender and a receiver, depending 
if data is to be sent from said device, or to be received so 
by said device. 

[0082] If the present invention is implemented accord- 
ing to the embodiment shown in Fig. 8 in a device acting 
as a sender, control can be performed such that the 
device appropriately determines one or more bandwidth 55 
values for the links (step St1 in Fig. 8) and then deter- 
mines the minimum (step St2). Any of the possibilities 
mentioned above in connection with steps St1 and St2 



can be used. The determination of the delay indicative 
value (step St3) can also be directly performed as 
described above, e.g. by measuring the time that 
passes between the sending of a byte and the receipt of 
the acknowledgment covering said byte. The product of 
the minimum bandwidth value and the delay indicative 
value can then be calculated in said sender and appro- 
priately used in the flow control as the bottleneck win- 
dow. 

[0083] If on the other hand the present invention is 
implemented according to the embodiment shown in 
Fig. 8 in a device acting as a receiver, control can again 
be performed such that the device appropriately deter- 
mines one or more bandwidth values for the links (step 
St1 in Fig. 8) and then determines the minimum (step 
St2). Any of the possibilities mentioned above in con- 
nection with steps St1 and St2 can again be used. The 
determination of the delay indicative value in the direc- 
tion from the sender to the receiver can be performed in 
any suitable way. One possibility is the sending out by 
the receiver of a dedicated connection delay time meas- 
urement message to the sender and measuring the 
time until a corresponding acknowledgment is returned 
This necessitates that both the receiver and the sender 
in the connection operate according to a protocol that 
supports such delay time measurement messages. In a 
preferred embodiment, such a protocol is not neces- 
sary, because the receiver can independently deter- 
mine the delay indicative value. It is only assumed that 
a system of acknowledging the receipt of data is given 
between the sender and receiver. Then the receiver will 
determine the RTT of the connection by measuring the 
difference between the sending the acknowledgment 
ACK(n) and receiving a segment covering byte number 
n+1 , where ACK(n) refers to the acknowledgment for all 
bytes including and up to byte number n in the 
sequence being sent by the sender. The thus deter- 
mined value can be directly used for calculating the bot- 
tleneck window, or a smoothing and/or averaging can 
be performed, similarly to the above explanation in con- 
nection with the values Ft and A. The bottleneck window 
can then be provided to the sender in any appropriate 
way, e.g. in the form of the advertised window, as 
already explained above. 

[0084] According to another embodiment of the inven- 
tion, which will be described in the following, the inven- 
tion is applied to TCP communication, and the following 
definitions will be used. It should be noted that TCP in 
the just mentioned sense refers to the transmission con- 
trol protocol used on the internet, in the sense that all 
past, present and future variations and implementations 
of this protocol, e.g. in accordance with any predomi- 
nant standard, are included. 

[0085] A communication device in which the TCP pro- 
tocol is implemented and which forms one end of TCP 
connection is referred to as a TCP peer". Each TCP 
peer can run as a TCP sender or TCP receiver or as 
both at the same time. A TCP peer that is modified 
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according to this invention is called a "modified TCP 
peer", otherwise it is called a "standard TCP peer". The 
terms "modified TCP sender", "modified TCP receiver", 
"standard TCP sender" and "standard TCP receiver" 
are used accordingly. Without the qualifier "modified" or 
"standard", the relevant terms refer to both cases. For 
the purpose of explanation, the standard TCP peer is 
assumed to be implemented according to the above 
cited book by W.R. Stevens, TCP/IP Illustrated, Volume 
1 , but this embodiment is applicable to any variation of 
TCP, as long as the assumptions and preconditions set 
out in connection with this embodiment are met. 
[0086] According to this embodiment, a modified TCP 
peer is a standard compliant modification of a standard 
TCP peer, i.e. a modified TCP peer behaves conform to 
the current TCP protocol standards, which guarantees 
backwards compatibility with existing TCP implementa- 
tions. 

[0087] The term "Maximum Link Bandwidth" (MLB) 
will refer to the bandwidth of the physical connection 
corresponding to that link, which is available to the 
sender on said link. 

[0088] The minimum of all MLBs that are taken into 
consideration by a modified TCP peer for a particular 
direction of a TCP connection (send or receive) is called 
"MinMLB" of the relevant direction. It is to be noted that 
the MinMLB can be different for the send or receive 
directions of a TCP peer as the path of links for the send 
direction is not necessarily the same as the path of links 
for the receive direction. Furthermore, it should be 
noted that the MinMLB as defined above is not the min- 
imum of all MLBs of all links that constitute a TCP con- 
nection in one direction. In most cases a modified TCP 
peer will not take all MLBs into consideration, e.g. 
because it is not necessary or they are not known to 
him. The MinMLB can change over time, e.g. as the 
value of a known MLB changes, or a new MLB is taken 
into consideration, which was not taken into considera- 
tion before, and this new MLB is lower than the previous 
MinMLB. 

[0089] The term "bottleneck window" for a given direc- 
tion (send or receive) is used for the product of the cur- 
rent MinMLB in that direction and the current RTT in that 
direction. As with the MinMLB, the bottleneck window 
can be different for the send and receive directions of a 
TCP peer. 

[0090] In accordance with the present embodiment, a 
modified TCP sender is restricted to not send faster 
than the current MinMLB of his send direction and that 
a modified TCP receiver will control the corresponding 
TCP sender to not let him send faster than the modified 
TCP receiver s current MinMLB of his receive direction. 
The latter is equivalent to saying that the corresponding 
TCP sender is not allowed to send faster than the cur- 
rent MinMLB of his send direction. 
[0091] Not sending faster than the MinMLB means 
that the TCP sender will not be allowed to have more 
unacknowledged packets outstanding than given by the 



20 

bottleneck window of his send direction. A modified 
TCP sender will continuously trace the current MinMLB 
and the current RTT of his send direction. A modified 
TCP receiver will continuously trace the current MinMLB 
5 and the current RTT of his receive direction, i.e. trace 
the bottleneck window of the corresponding TCP 
sender's send direction. 

[0092] According to the present embodiment, the flow 
control in the modified TCP sender is supplemented by 

io the bottleneck window of his send direction, i.e. the bot- 
tleneck window is used together with the advertised 
window and the congestion window in determining the 
control window used. The control window is chosen as 
the minimum of the three windows, which means that 

is the modified TCP sender may not have more unac- 
knowledged packets outstanding than the minimum of 
the advertised window, the congestion window and the 
bottleneck window of his send direction. Furthermore 
according to the present embodiment, the modified TCP 

20 receiver determines the bottleneck window of his 
receive direction, and then advertises the minimum of 
bottleneck window and the window he would advertise 
according to standard TCP (e.g. the input buffer limit) as 
the advertised window to the TCP sender. 

25 [0093] If the embodiment is implemented in a device 
acting as a sender, then the determination of the RTT in 
the sending direction, which is used in the determina- 
tion of the bottleneck window, can be done by measur- 
ing the momentary RTT by monitoring the time lapse 

30 between the sending out of a byte having a specific 
sequence number and the receipt of the acknowledg- 
ment from the receiver relating to the receipt of said 
byte. This value is referred to as M. Then an error value 
Err is calculated and an average value A is updated at 

35 each measurement of M in the following way: 

Err = M - A, 
A <— A + gErr, 

40 

where g is a gain value for determining the average. A 
typical of g is 0.125. The momentary value of A is then 
used as the RTT value employed for calculating the bot- 
tleneck window. 

45 [0094] If the embodiment is implemented in a device 
acting as a receiver, then the determination of the RTT 
in the sending direction (i.e. the direction from the 
sender to the receiver), which is used in the determina- 
tion of the bottleneck window, can be done by measur- 

so ing the momentary RTT in a modified way. 

[0095] The current RTT value, which will again be 
referred to as M, is determined by monitoring the time 
lapse between the sending out by the receiver of an 
acknowledgment ACK(n), which acknowledges the 

55 receipt of all bytes including and up to byte number n, 
and the receipt by the receiver of the TCP segment cov- 
ering byte number n+1. The employed value of RTT is 
again determined as A in the following way: 



11 



JNSDOCID: <EP 0948 1 68 A 1 \ > 



21 



EP 0 948 168 A1 



22 



15 1. 



20 



Err = M - A, 
A <r- A + gErr. 

[0096] As the situation in the reverse direction is not 5 
identical to the situation in the sending direction, a prob- 
lem occurs when the segment covering byte number n 
is delayed at the TCP sender, e.g. because the applica- 
tion has not released it yet. In this case the measured 
momentary RTT M should not be used to update the io 
value A, i.e. such values of M should be skipped. The 
decision of skipping is done on the basis of the inter- 
packet arrival time of TCP packets received by the Claims 
receiver. In other words, according to the present 
embodiment, the modified receiver measures the 
packet inter-arrival time along with the momentary RTT, 
and compares the arrival time with a threshold, and if 
the arrival time exceeds said threshold, then the meas- 
ured momentary value RTT is not used to update A in 
the above mentioned formula. 

[0097] According to the present embodiment, the 
device running according to the present invention, be it 
as a sender or as a receiver, determines the MinMLB as 
the bandwidth of its access link that is momentarily 
available to the device. Only one MLB is determined 25 
which is automatically equal to the MinMLB. As the 
access link is used in both directions, i.e. sending and 
receiving, no distinction between sending and receiving 
direction needs to be made in this case. The access link 
is the link that connects the device to the next router 30 
along the connection. In accordance with this embodi- 
ment, the available bandwidth is supplied by the link 
layer driver. The link layer driver keeps a running 
throughput metric that takes the recent past into 
account, i.e. it measures the throughput of data (in 35 
bytes) over intervals of time and divides the measured 
throughputs by the length of said intervals, to thereby 
continuously measure the bandwidth as said quotient of 
the throughput and interval length. This is done continu- 
ously, i.e. after one measurement over an interval has 
ended, the next is begun. Another possibility is to take a 
running average over a span of a given amount of time 
(e.g. a few seconds) that has passed. This function can 
be implemented into the link layer driver of the device, 
by appropriately implementing used link layer protocol 
e.g. SLIP, PPP or RLP. Amending the implementation 
means that the standard protocol is fully retained, such 
that communication with any standard implementation 
is retained, i.e. compatibility, but that the above men- 
tioned special function of bandwidth determination is so 6 
added into the implementation at the device operating in 
accordance with the present embodiment of the inven- 
tion. 

[0098] Conventional techniques for improving TCP 
performance require that the implementations on both 55 
end points (i.e. sender and receiver) of TCP's bi-direc- 
tional communication path be modified. Consequently, 
for such a technique to be successful, all existing TCP 



implementations of those hosts with which communica- 
tion is sought would have to be upgraded. Given today's 
wide spread of internet servers, this would be impracti- 
cal. Other approaches to improving TCP performance 
require maintenance of per TCP flow state in the net- 
work, resulting in the drawback of per flow resource 
demands in the network. 

[0099] The above embodiment has the advantage that 
TCP performance is increased both in the send and 
receive direction by modifying only one side of an end- 
to-end TCP connection. 



2. 



40 



45 



4. 



A method of controlling the flow of a data amount 
from a sender to a receiver in a packet exchange 
connection, said packet exchange connection con- 
sisting of a plurality of links connected by routers, 
comprising: 

controlling said sender to determine from said 
data amount a data sequence to be sent, 

automatically determining one or more band- 
width values respectively associated with one 
or more of said links, and 

employing said one or more bandwidth values 
in the process of controlling the flow of said 
sequence from said sender to said receiver. 

The method of claim 1, characterized in that said 
one or more bandwidth values are determined 
more than once during the sending of said 
sequence. 

The method of claim 1, characterized in that said 
one or more bandwidth values are determined at 
regular intervals of time during the sending of said 
sequence. 

The method of claim 1, characterized in that said 
one or more bandwidth values are determined con- 
tinuously during the sending of said sequence. 

The method of claim 1, characterized in that said 
one or more bandwidth values are determined 
before every sending of a new packet. 

The method of one of claims 1 to 5, characterized 
by 

acknowledging the receipt of data in the 
receiver by returning to the sender messages 
that indicate up to which point in said sequence 
data has been received, 

controlling the sending of said sequence in said 
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sender at a point in time such that only some or 
all of the data inside a data window can be sent 
at said point in time, said data window being 
defined by a first and second limit with respect 
to said sequence, said first limit being deter- 5 
mined in dependence on the amount of data 
already sent and acknowledged, such that said 
amount of data already sent and acknowl- 
edged falls outside of said window, and said 
second limit being determined by adding a data w 
window size value to said first limit, and 

employing said one or more bandwidth values 
in the process of determining said data window 
size value. is 



24 

in that said packet exchange connection is estab- 
lished in accordance with TCP and said time value 
is determined as a function of the round trip time for 
said connection in the direction that the sequence is 
to be sent. 

12. TTie method of one of claims 1 to 1 1, characterized 
in that the bandwidth value associated with a link is 
the physical bandwidth of said link. 

13. TTie method of one of claims 1 to 1 1 , characterized 
in that the bandwidth value associated with a link is 
the bandwidth currently available to said connection 
in said link in the direction from the sender to the 
receiver. 



7. The method of daim 6, characterized by the steps: 

determining said one or more bandwidth val- 
ues associated with said plurality of links in the 20 
direction in which said sequence is to be sent, 

determining the minimum of said one or more 
bandwidth values, 

25 

determining a time value that characterizes the 
amount of time that passes between the send- 
ing of a given byte by said sender and the 
receipt of an acknowledgment that said given 
byte has been received by the receiver, said 30 
time value for said connection being deter- 
mined in the direction in which said sequence 
is to be sent, and 

determining the product of said minimum of 35 
said one or more bandwidth values and said 
time value as a link dependent data amount 
value, which is employed in the process of 
determining said data window size value. 

40 

8. The method of claim 7, characterized in that said 
link dependent data amount value is used as said 
data window size value. 

9. The method of claim 7, characterized in that said 45 
data window size value is determined by selecting 
the smallest value from a group of data amount val- 
ues, said link dependent data amount value being 
among said group. 

50 

10. The method of claim 9, characterized in that said 
packet exchange connection is established in 
accordance with TCP, and said data window size 
value is selected from the group consisting of the 
advertised window, the congestion window and ss 
said link dependent data amount value. 

1 1 . The method of one of claims 7 to 10, characterized 



14. The method of one of claims 1 to 13, characterized 
in that said bandwidth values comprise at least one 
of the bandwidth values associated with the access 
link of said sender and the access link of said 
receiver, said access link of said sender being the 
link connecting said sender with the next router 
along said packet exchange connection in the 
direction said sequence is to be sent, and said 
access link of said receiver being the link connect- 
ing said receiver with the next router along said 
packet exchange connection against the direction 
said sequence is to be sent. 

15. The method of claim 14, characterized in that said 
bandwidth value associated with an access link is 
provided by the link layer driver for said access link 
in one or both of said sender and said receiver. 

16. A device for controlling the flow of a data amount 
from a sender to a receiver in a packet exchange 
connection, said packet exchange connection con- 
sisting of a plurality of links connected by routers, 
comprising: 

a determining means for determining from said 
data amount a data sequence to be sent, 

a means for automatically determining one or 
more bandwidth values respectively associated 
with one or more of said links, and 

a means for employing said one or more band- 
width values in the process of controlling the 
flow of said sequence from said sender to said 
receiver. 

17. A communications device for sending and receiving 
data over a packet exchange connection, said 
packet exchange connection consisting of a plural- 
ity of links connected by routers, comprising 

control means for controlling said communica- 
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tions device, 



when it acts as a sender for sending an amount 
of data over said connection, such that a data 
sequence to be sent is determined from said s 
data amount, one or more bandwidth values, in 
the direction in which said sequence is to be 
sent, respectively associated with one or more 
of said links is automatically determined, and 
said one or more bandwidth values are used in w 
the process of controlling the flow of said 
sequence from said sender, and, 

when it acts as a receiver for receiving data 
over said connection from a communications 15 
partner at the other end of said connection, 
such that one or more bandwidth values, in the 
direction from said partner to said device, 
respectively associated with one or more of 
said links is automatically determined, and a so 
message is sent to said partner such that said 
one or more bandwidth values can be used in 
the process of controlling the flow of said data 
by said partner. 

ID TU -i 25 

is. The device of claim 17, characterized in that said 
control means function such that said one or more 
bandwidth values are determined more than once 
during the sending of said sequence when said 
device acts a sender, and said one or more band- 30 
width values are determined more than once during 
the receiving of said data when said device acts a 
receiver. 

19. The device of claim 17, characterized in that said 35 
control means function such that said one or more 
bandwidth values are determined at regular inter- 
vals of time during the sending of said sequence 
when said device acts a sender, and said one or 
more bandwidth values are determined at regular 40 
intervals of time during the receiving of said data 
when said device acts a receiver. 



20. The device of claim 17, characterized in that said 
control means function such that said one or more 45 
bandwidth values are determined continuously dur- 
ing the sending of said sequence when said device 
acts a sender, and said one or more bandwidth val- 
ues are determined continuously during the receiv- 
ing of said data when said device acts a receiver. so 

21. The device of one of claims 17 to 20, characterized 
by the protocol for sending data over said connec- 
tion being such that a receiver acknowledges the 
receipt of a sequence of bytes by returning to a ss 
sender of said bytes messages that indicate up to 
which byte data has been received, and the send- 
ing of a sequence to be sent at a point in time being 



performed such that only some or all of the data 
inside a data window can be sent at said point in 
time, said data window being defined by a first and 
second limit with respect to said sequence to be 
sent, said first limit being determined in depend- 
ence on the amount of data already sent and 
acknowledged, such that said amount of data 
already sent and acknowledged falls outside of said 
window, and said second limit being determined by 
adding a data window size value to said first limit, 

where said control means, when said device 
acts as a sender, uses said one or more band- 
width values in the process of determining said 
data window size value, and 

said control means, when said device acts as a 
receiver, determines a data amount value on 
the basis of said one or more bandwidth val- 
ues, said data amount value being sent to said 
partner in said connection, such that said data 
amount value can be used in the process of 
determining said data window size value in 
said partner. 

22. The device of claim 21, characterized by said con- 
trol means. 

when said device acts as a sender, determining 
said one or more bandwidth values associated 
with said plurality of links in the direction in 
which said sequence of data is to be sent, 
determining the minimum of said one or more 
bandwidth values, determining a time value 
that characterizes the amount of time that 
passes between the sending of a given byte by 
said sender and the receipt of an acknowledg- 
ment that said given byte has been received at 
the other end of the connection, and determin- 
ing the product of said minimum of said one or 
more bandwidth values and said time value *s 
a link dependent data amount value, which is 
employed in the process of determining said 
data window size value. 



23. The device of claim 22, characterized in that said 
packet exchange connection is established in 
accordance with TCP and said time value is deter- 
mined as a function of the round trip time for said 
connection in the direction that the sequence is to 
be sent. 

24. The device of claim 21 or 22, characterized by said 
control means, 

when said device acts as a receiver, determin- 
ing said one or more bandwidth values associ- 
ated with said plurality of links in the direction in 
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which data is to be sent, determining the mini- 
mum of said one or more bandwidth values, 
determining a time value that characterizes the 32. 
amount of time that passes between the send- 
ing of a given acknowledgment message cov- 5 
ering a certain byte by said receiver and the 
receipt of the next byte in said sequence of 
data being sent from the partner in said con- 
nection at the other end of said connection, and 
determining the product of said minimum of w 
said one or more bandwidth values and said 
time value as a link dependent data amount 
value, which is sent to said partner to be 
employed in the process of determining said 
data window size value by said partner. 75 



exchange connection. 

The device of claim 31, characterized by having a 
link layer driver means, and said bandwidth value 
associated with said access link is provided by said 
link layer driver means. 



25. The device of claim 22 or 24, characterized in that 
said link dependent data amount value is used as 
said data window size value. 

20 

26. The device of claim 22 or 24, characterized in that 
said data window size value is determined by 
selecting the smallest value from a group of data 
amount values, said link dependent data amount 
value being among said group. 25 

27. The device of claim 26, characterized in that said 
packet exchange connection is established in 
accordance with TCP, and said control means, 
when said device acts a sender, functions such that 30 
said data window size value is selected from the 
group consisting of the advertised window, the con- 
gestion window and said link dependent data 
amount value. 

35 

28. The device of claim 26, characterized in that said 
packet exchange connection is established in 
accordance with TCP, and said control means, 
when said device acts a receiver, functions such 
that said link dependent data amount value is sent 40 
to said partner in said connection as the advertised 
window. 



29. The device of one of claims 17 to 28, characterized 

in that the bandwidth value associated with a link is 45 
the physical bandwidth of said link. 

30. The device of one of claims 1 7 to 28, characterized 
in that the bandwidth value associated with a link is 
the bandwidth currently available to said connection 50 
in said link in the direction in which said data is to be 
sent. 



31 . The device of one of claims 1 7 to 30, characterized 
in that said bandwidth values comprise the band- 55 
width value associated with the access link of said 
device, said access link being the link connecting 
said device with the next router along said packet 
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Fig. 8 
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